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(57)Abstract 

PROBLEM TO BE SOLVED: To provide an image 
generation system which provides a composite image 
having been merged more for an observer by reducing 
the temporal deviation between real-space video and 
virtual-space video. 

SOLUTION: On a computer 107, position and direction 
measuring software 320, position correction marker 
detecting software 330, gaze direction correcting 
software 350, effect sound output software 340, and MR 
space video generating software 310 run respectively. 
On a computer 108 connected to the computer 107 
through a network 130, MR space state managing 
software 400 runs. The MR space state managing 
software 400 manages the position, direction, and states 
of all real space bodies, and the position, direction, and 
states of all virtual space bodies. A virtual space state 
management part 401 in the MR space state managing 
software 400 manages the positions, directions, and 
states of the virtual space bodies. 
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0 R^.W\±Xcr>mm^^f- tit V ^ !> t 

[ 0 0 6 3 ] 0 6 KSptJ: ? C it. ■mSMPtJjfii* 

y^\m 1 0 2 TftiJ^n^^aa, nmxmw 
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mp^Mztitv-ficomM mfcfi' ( f l 

W«*fftS*6 (F8, Fl 2) . 
[0 0 64] ZC02^mmmt. MRS 

«^#rawijt*ti**6 ( f 1 4 ) . zm&i 

iittimi m R$lH*<6«»;frtofc:affi** i k fc J: 

iafc£**i^*tfiE** ; tars & ( f i 5 . f 1 

6) . s5r*s". _LIB0IK*5VVC. 1 2 

OtJ;l>'mfflIE&fffc^o^^fiJ*[a*WF 1 

7(as*. ; 

[00 6 5] ^^rAO^aSrfTanytj.- 
9\ 0 7<7)A-h*?*7lf®, V7Hi7jSt, fcJt 
**i«i«>y 7 r- 7x7^iSmc^TlM!tl> . 

[00 6 6] 3^tW10 7WvH^s7 
»lSt:-3^T@l7t#ML*3&*feKl»tS. 07(201 
<0B«4«^'fAtei3tt*3 Vta-^ 1 0 1(T)>\- 

[0 0 6 7] ayt'A-^i 07tt, 0 l iZTjki-X o 

it, %m%i o o a , i o o b , ioo cmzm-fh 

t*-?l 0 7'(£«t, =frBJBtr?#**7 , f-*#-F 1 
5 0 , £a$t rtf **7'^i<- H 1 5 1 , fegffl^ 
774 HI 52, ifelffl^??-* <y?#-Yl 

53, ^yh'jJf-Hl 58, ^W-JAVJ-y 
i-Xl 5 9fcJ;l»Ur;My^-7x-Xl 5 4*' 

A'XSrtf-LTCPUl 5 6, HDD (/v-Kt'**7) 

1 5 5fcJ;t*X*iJ 1 5 7fc«tt3;h.T^6. 
[0068] fcSffltr** -Y7°f--r#- h' 1 5 0 \Z\% 
HMD10 1^|fflt'fW720 3*', fiSffltf 
T r-* 1 5 1 tU±£Bfflf7 , 3r^>«9 2 

1 5 2CI4HMD 1 0 1 <9£gfflj^=SB2 0 1 , 
£ g ffl ^ 7 ^ v 9 i)f- K 1 5 3 Ct±fe @ fflfl^l§» 2 
0-2***n-f!h««$^TV^. ^yh'^-Hl 58 
fcttxt-^ 1 0 5tf®ffiZti. +■» h 

7x-* 1 5 9(4, LAN (Local Area Network) &fc' 
<0*<y b7-? 1 3QCS8tt3tLTV>4. isVTJMy 
?-7x-X 1 5 4CI1 fig^t^fl 0 
SKSfU fiBtfirift-fe.^Rftl 0 6(511, HMD 10 
lc05I^fifB73l6]^y-9-SfI«l 0 2, 3M»{tatfrH|-fc 

1 o 3 a J: WMRr M* >^ft« 1 o 4 

[0069] Slffltm V 1 

50, 1 5 1 ML £@fflt'f:*#*520 3 ( 

2 o 4*>^^Wft^&rx^;HkL3yh^-^ l o 



iCOS&JlZl 5 7K3 0 7l'-A/^r]ROatf. IX 
-f 7?#-Kl 5 2, 1 5 3^\Ji}7J$fl, SB 

[007 o ] ffljtfriftusyir** i o 6(4, aawaattr 
ifti-t vi^sffiw 102, #»fiB*w-fe>^5im« i o 

3 #gft LfeTOfift^SftKWffl* ft i -j T , &ftg 

[0 07 l ] *7h7-^^-7j;-Xl 5.9fc» 
ttSfl* * >y h 7-? I 3 0 ttt , WBffiH l 0 0 a , 

10.0 b, 1 00c«3yt" a -?l 0 7fe ( £l«* 
&MR£|S|:R^S« : fI£fi : ifcAfWyta-* 108 

[0072] #K?S#1 00a, 100b, lOOcfc 
ttJ£-f£3yt°A-:M 0 7(4, ayea-^'l 0 8t 
J;D, *»b7-?l 3 4H»#10 0 

a , 10 0b, 100 c»fcttffl3#ifc«t£ffiB, £K 

Os §3yf A -^ i o 7mfcLT*sa*i o o 
a, loob, i oocizm-iMRQmm£.m- 

[0073] ttz, M RSIHTaW'f ^y h fr'jffi; 

^y yvm.LtiM R&mmmtzim. 

^fifexh"-^ l o 5 ^4|fi5flWr4>#ii*»-; Mny 
t*.-^#a9W4*>-i:^'5|#frt)*7 h7-? 1 3 0 

[0074] *HM«0^«Ti4, Z^Tca y/"C-r 

n LX 1 ^ct) a y t a - ? fef ijffl t & J: o t flbfi t X ^ 

•g.^', ATl^&HiXTC^yA-^til.Page Flip^ 

***** 1 *W>**:r*r#~ b'^Uc 0 , 

2 i mr? 7 4>v? ^nz tu*) , *fc, 

l«W/57< 7^^-FT'Above & BelowtBSj^/7 
&\ 

[007 5] »C(C. *^rAO«!a!tf?'3 3yta- 
# 1 0 7 «07 7 r- x TffilSt 
0 8 *#flg U!3r*«^ffiWrs . H8(i0 WlMly 
XT&cr>a & h° A-r-? V 7 h 7 x T«0 

[0076] nyfa-^l 07tt3V>T{4, -08 fc* 
*Jt -5 ©a^|fi]f+ffly 7 h 3 2 0 , ffliMtiE'?-* 
my 7 h 3 3 0 , WMiMBiEV 7 h 3 5 0 , 
as* y 7 h 3 4 o , m Rsra W«y 7 h 3 1 0 C0# 

y7>'7xT**»^*l». #y7h7xTii, HDD 1 
5 5lZlfcM%tlX& y ). CPU1 56fcJ;i?HDDl 5 
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[0077]»tl00a, 100b, 100c» 
3ye*-^10 7li : 3 0.ifr#UT3 

ye*-* 1 pafcftRS'ii, .3ye.3.-*'i.0 8fc*$. 
v vt MRSlS«Jlwrasy 7 b 4 0 0 jWttfts-r* . 

[ o o 7 8 ] wmmmxte. mmmL 
xtmhtix^hM Rsmmmmco a y e* - * i 

0 7 fclifjijoayt:*-? 10 8±T\ MRSBHRWt 
ay 7 H4 o o&i#s'*tv^^ fflSMfctttisiHtf 
=Sr»-mtf. MR2iaw«iMPiiy 7 b4 o o^ayt*- 

* 1 0 7 •CiWS €S.J: 3 i: t,TS £ . 

[0079] ammmv y b 3 2 0 \t s mm* 

ytttsfrl 0 5 1 5Hi*ffv\ #fil*[fi]-byfSftffi 

1 0 2, 1 0 3<0ftB, *|ft]S:ft)Itl) . * UT , *<75 

ftsifi^feMRsrajs^-r-^si^wMffia, 
iwtt«3*u ;<otmin±» WOT^-ty-* 1 0 
3 mmmt 1 1, (c. iM^^iEy 7 b 3 5 0 izm 

[0080] ffiKrfoffllV 7 b 3 2 0 Wy'iXft 
ttaj«3 2 1l4, #fitK^^>" , fl 0 2, 1 0 3(0ffi 

iRf V&imm* y-t l o 2 , l o 3 cofil^ 

m&i-z. zmn&tiv 
mtxmmniEvyh 3 5 otea«3*i4. 

[0081] fiMiiEV-;$$fcBy 7 b 3 3 0{±, MR 

mmtfLv? h 3 1 o commmmnm 1 2*&»<i 

Sill)JI^S»±liA^H«±tcS)£^-^ 1 2 0£ 

atfflu ^<oiim±w{aas:»^ffiiEy7h35 

Qtelfitt"*.-. 

[00823 W*[*lffliEy7b350(i. .ffiKffllft 

av 7 b 3 2 o*>^4.<ts«»#coffijSiffiji, mm 
fBfctoflisffir «^rfi]T^$tii>MR 
SiattfllKfeW&'V-* 1 2 ooffifsfuw-s. 
v-tf^wagfi, ffi«s§jEv-#$fty7 b 3 3 o 

&mm* y*%m i o 3 coast* , a fe s> 
ifttti § fife * urn r ws»4«y 7 h 3 1 o fc» 

[0 0 833 Mliftf^y 7 b3 40(4, MRWM 
y 7 b 3 1 0 SfciiMR£Htt!Gffl«y 7 b 4 0 OA>£, 
^^fci^t, J9r£*>»ftfN A-^^yb'S 

a-vV? (BGM) -Smb-t. MRW«4j«y7h3 
1 OtJ J:VMR«JIMray7 b4 0 014. Xt-* 1 0 
5«MR^*<DKil{iHfc±tf*e.-J& 1 0 5**«8R 

R3sia±-cwfe*»o«*>f b*^b ufc*£> mm 

A ^y b OSC: o-fe M Rffiia±<otM<oififif{c:» 4 * t° 



[0084] MRSIBIttJIMSay 7 b 4 0 0 (4, £TO 

mmtoxvmt^xit, MRwa&«y7h3i 
ofrbmmmcDnmu. «m *mavm 

^immaxwm^ ^tii, m R%mmm& 
y 7 b 4 o o nnmssmmmm o i #mm£ 

[0085] ioMRaaaiuaiMPay 7 b 4 o o a, <r 
nfewflf«i®««t^T<ows?#w=iytA<-^ i o 

7T"ttf^tT^|>MR^4i^y 7 b 3 1 OteSBSTf 

[0086] ti&^fflnwaaM o 1 \tmsm^ 
(Rasgajft*^»^s-fr6*^<oKiaiff5. 4fe, is 

1MW34 0 1 (4. li^^-t^^^Jl^m 

Xf^A^^-^feli^, ^fcWJBUTi/tU^tM 
[ 0 0 8 7 3 M R WI4fiS;y 7 b 3 l o ii. ISM 

ffl«MRffi|fflW«&-4J£U ll«^*«HMD 1 0 1 
<0*S^Kil20 1, 2 0 2fcaj*f 6. i^fflflBlt- 

4^a{4, ^ort«-c. ««KBSfiffl53 13, mm 

4K»3 1 1 , 3^W«]R^3 1 2 S fl«^aiS3 1 
4fcJ; l J#3ISflTV^. 

[00883 ^«^gtl^3 1 3 (4, »^^IEy 7 

b 3 5 o^fea»s*ifeSRiry!E#oa^taM-, sn^ 
i*i » ¥^iH^r6]-fey^Sfl«i 0 3«fiM, TJtftj. 
j;iAVxx^^^^wtMR^r B w^iy7 b4 o 

0£ffiXt&. *fe, MR2Sr B 1WI ; iiy7b4 0 0^ 

^^Tcom Rm®MzmtthW)ibcDii.mmZ.VW 

mmmmzmmtih. -$%h%. 'w&mmzo- 
^xmm^m^mm.. mm, mm. 
m*yy%tmio3com. m. &£vv**.+* 
ffffiazta. im%m%»mz^xte, ig.n%mm 
<mm o i imm-mm^mw^m.-nmxv : 
mtfwa&ti&. 'Sr^s im^mco^mi^xb-ti 

mxfo D . S y^£#Jttl>£Miftv\ 

[ 0 0 8 9 3 WNm&jm3 1 Ltt, MRffiTO®« 

ay 7 b 4 o QfrbwmtiKm&r®mtbmwm 
fcii/mi -tux, w^my7 b3 5 oa^ji 

1 0 0 9 0] 3 1 2(4, ^iffl, Sgffl 

t'f^^t/ft*- b" 15 0, 151 !6»fe3S|^|aiW 
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mM<0&fr, 1 5 7*fcttHDDl 55 (07 

[00 9 1 ] mmmi i 4Mt; J:f»aWU£ 

5|iS»^^ * U 1 57 4fc«8 D D 1 5 5*^M 

20 1, 2 0 2fc|U3j-fl.. 

[0092] fiLtffi^LfcA-h*^xrfcV7 h^xT 
l>. 

[00 93] «4»S6#*«JL& M RffiBWIMftti. *C0W& 
36*MRSIBHKIIMPay.7 MO O.fcj: O-TC^StSftT 

[ o o 9 4 ] mz. mmrmmummmmmm 
mtimmi mco\ w nm&mv y vcomm 

mtii.vt H 9 fcv > L0 1 ' 1 Sr«B L %tfh%m 
&. 

[ 0 0 9 5 ] [29 {412 1 mm&LvZT^CDMRm® 

mm&mzmmi^- y * *t*5 j; v y 7 b xt 

fcs *<Ofl|^attLfc*«««t^t0, Hi 0(409 

•v— K HI 1^9.»MR(IHW^V5h«3lMlst* 
t7n-f-*-bTt>l>. 

[00 9 6] MRR«4*V-7h31 0T14, 09fc«k 

via 1 1 i 3 (c., MRagBRtnpiy 7M00 

l^hAmm^M 3 1 3 fc.M R^ftfirtWMSftS t 
Ur-yTS 10 0), H«£jSSS3 HtlSSPtSI* 

«ffiH<o«^*, «»^«3 1 uzmmmm 

4^»frft«i**i|tf?** (Hl0e«tAl, A 
10).. 

[0097] fftt£j£ffi3 1 4f4, Jt$*SWT8£W 
flUKfeas 3 1 2 3&».fc«W«OS9eW«T- 9 * a t- L 
(HI 0<9A2) s nyfa-^l 0 7O^^U 1 57 

±.mmmm% i^fyrs 102), 

[0098] ^0HK£ftffi 3 1 1 «4, TOSftgtf 3 1 

7 t mmh^.mimm<omxmthz t fcBMw 

6 (121 0(0 A 1 1 ; Xf7 7S 104) , 
[009 9 ] #Mfi<0ffMT14, Xf77S 1 0 

2 1 S 1 0 4 & , HSWtl,,): a l/C^*#; -7 

[0 10 0] *LT\ MRWft$(ftV7h3 10tt, ffl 
fl^l«i53 1 4«^S^B*«JSlI»Ifc«Wi«4i^ 

^53 1 2com^.mim.mmt) i m ( a 1 2 > -r & 

c0£#*> (X-f-vTS 10 6), :«(|MS3 1 4 
cO^IISraM®H»fcJ;V'{R««4«3 1 2 <0 
«ffl^ra»4)S«IA«T-ri.i:, HttteJS»3 1 4 

[0101] Htt^jSHS3 1 414, «*#<0«j£ffiB, 



10 7). ±IBflHB<0Sg«n6«tf*><xTV^*^ 

08) , C<D*$TCO*MfiB, »^^M^.I>M 
ffilBJWMRcoflWij&ff -5 Uf-/7S1 1 0) . ^co?M 
ftg, M£fi££igLT*8BTri>»!l4, fflIi«HB£ 

mz&Kx m*% & ii < . w^fc^ sit 

V>. ±lBtt«a^3*iT*V^£{i s ±IBXr-yTS 
10 8, S 1 1 0 yrLT*<9*'*fi«2iai«« 

[0102] -et-c, fffl&jfts 3 1 4 «4ffiH Ltzmm 
mm&tm&mmikfc i , ^*ns 1 o taja 

1-1). (Xr-v7Sl 12) 

ELtc-s&oM Rsaiii!MRftjs«ia)W»7'r * . i z 

(XT77S1 14) . 

[0103] m-mmmco&wz. immgrns 
1 4*«MRSia«««ay7 h4 o ofrbmu*m& 

W&tijte* 1 **, B(10K**-J:$te, 
A r , A 1 0 ' , A r ' , A 1 0 ' ' CO £ 0 \Z%C0 

gtfmztiitf* iixummm? 1 4*^iax 
r-y7s i o oz'Wto#*>->fcfr&fr&mK&£"&m 

[ 0 1 0 4 ] ZCOX o t, «WS#*«1.6MRffiiaieMR 

o««i!&sMRS(S]Wiay7 h 4o otc± o-ffi^a 
sww. 3S5I3EBI m t 1 1 mm 

««^6ifc* tii rtBt'flr6. mmcomm 
mm m *n mt 1 1 1 ^tgt=or •? , mm^mm^ 
t um&wmcommxv mmt h z. t ^ v c# 
uRmm.^^m^^z^mmmm.tL 

T, HMD 1 0 1 JflllfctlCli, 

[0105] fiLhi 0 s *^XtAT"{4, Ji^SraHU!* 

S M RSia««*«R#K:i&K^ h Z. b h . 
[ 0 1 0 6 ] ±Jfio5Ut»JB<0«IB ( El 1 It* 

~? (s/c{4cpu^mpu) 

[0107] zoom, mmm^mftztitzrv? 
? a a- k gwt t tzmmmmcommimR-th z 

mmmmizk^t. 

[0108] rvyj^-Yzmthtz&cowm 
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ftr^X?, «fa;, CD-ROM, CD 
-R, Smr-r. ^^tt^^U^-F, ROM, 
D V D - RO Mft fc"£fflV >* CI i: & . 
[0 1 0 9] 3>t°*-?m%ll!,lt.iyn7'7l> 

3>e A -^.hT-^«!lLTV^OS (jj-^k 

[oiio] s^ic ic««E**>fcaffis*iJtrp^5 

6 CP Ui&^*^BKOJ0a«)--IB*fc«^«*ffv\ * 
[0111] 

mmmm^mzx ~> x msMzmmm<<& 
i # * (offin - mco m * twits «a 

Sr^rt-SWT, «^IBWW»t fe^iaw«<0ii* 
[0 1 1 2] ^HJI^jij^^^^tiWj;'. Wm 

mmmxi/mumzmnm^mmmh 
mt . mmmffltifcMzmtvzhZMztfiEthm 

*J»t4iIieBaEiaiW«*4jS1-SlSi: - fwnmcfct 

t , m&tsim t w&mmt Lfc«£«« 
[oi 1 3] *»wwiatm«!fcJ:<itf. /o/5A 



WOWttK l>Df*fc J; iff ifir 

*".•"•>. 

[0ffi«lj&$&fP§:] 

[Bin ^mmm^-mmmmm^^T^ 

[02] Hi<o««#<Ol!HBt:36*Sfi6HMD^)fl!)a 
[03 ] £Ttf>fl^lBHirf^frfcft**^MR£ 
[04 ] ajttRS^flji*tffifflL*^«^WMRSia 

[me]micomm^xrMzmt'?~^i l zxt 
imiYmmmfci'ZTMzm&zyvx.-? 

1 0 7 W A- Y V x 7* fiMSErC* h . 

[138 ] Hi »B«4«^xt 1 a«3 y tr * -j? tcjm 
stuty 7 h x Tffifmx-h & . 

[09 ] ei i comm^^xT^coMRmrmmm. 
izm&t h a- h *jr x rfc j: t/'v 7 h ^ i r t , 
fgcosnt m^mzmmx-foz. 

[010] 09(OMR^«V7hCOl!)flH^-f sy/ 
[011] 09c7)MR^«V7b«ld^?r^t7n 
IflPfWlHf]] 

100a, 10 0b, 100c H2&# 

101 HMD 

102 

103 ^^g^ffiUzy^flli 

104 mm*y?mim 

105 Xt-* 

106 {4fi*[ftHryr*f*: 

I 0 7, 1 08 3 ye j.-? 

I I o mmmfo 

120 

130 ^vh 1 ?-^ 

15 0, 151 f'T^-vTf-^*- H 

1 5 2, 1 53 fr<?7H??tf-Y 

154 yyr;wy^-7x-x 

15 5 H D D 
156 CPU 
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157 Xt»J 

158 ^y^jK-H 

159 *>y hV—?4 y?-7x-Z 
20 1 £Sfflf^lS 

202 ammmw 

2 03 £BffltfTtf;M5 

2 04 £ gffl b'r 5 

310 MRmmmvyh 
311 



3 1 2 
313 

320 mmmwyh 

34 0 s&S^tfcT/^b 
3 50 ffl«^rWfflriEV7h 



321 
330 



400 
40 1 



■[02] 
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F?-A(##) 5B050 AAOO AA08 BA06 BA08 BA09 
BA11 CA07 CA08 DA07 EA07 
EA13 EA19 EA24 FA02 FA06 
FA09 FA10 

5B057 AA20 BA02 CA12 CA16 CB13 
CB16 CE08 CE12 DA07 DA16 
DB02 DB08 DC33 DC36 

5B087 AA01 AEOO BC05 BC26 BG2 
DEOO 



